Information processor, information processing method, and computer program

ABSTRACT

An information processing apparatus including a detector that detects movement of a manipulation body in a vertical direction in relation to a display, and a processor that determines a speed of movement of the manipulation body based on an output of the detector, and determines a process to be executed based on the determined speed of movement.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and is based upon and claims thebenefit of priority under 35 U.S.C. § 120 of U.S. Ser. No. 14/594,736,filed Jan. 12, 2015, which is a continuation of U.S. Ser. No.14/264,691, filed Apr. 29, 2014 (now U.S. Pat. No. 8,952,931) which is acontinuation of U.S. Ser. No. 13/220,207, filed Aug. 29, 2011 (now U.S.Pat. No. 8,736,575) and claims the benefit of priority under 35 U.S.C. §119 to Japanese Patent Application JP 2010-199638 filed in the JapanPatent Office on Sep. 7, 2010, the entire content of each of which ishereby incorporated by reference.

BACKGROUND

The present disclosure relates to an information processor, aninformation processing method, and a computer program. Moreparticularly, the disclosure relates to an information processor forexecuting manipulation controlling processing for a GUI, an informationprocessing method, and a computer program.

Since a touch panel can realize a user interface (hereinafter alsoreferred to as “a UI” for short) which is intuitive and easy to use,heretofore, the touch panel has been used in ticketing devices oftransport facilities, ATMs of banks, and the like. In recent years, thetouch panel has come to detect an operation made by a user, and thushave come to realize different manipulations for an apparatus than othermanipulations made by using existing buttons. As a result, in recentyears, the touch panel has been frequently used in portable apparatusessuch as a mobile phone and a game apparatus. For example,JP-T-2010-506302 discloses an apparatus which starts tactile sensationfeedback before a user comes in contact with an input area of a touchpanel or the like based on presence of an object lying in the vicinityof the input area of the apparatus, thereby generating a tactile effecton the apparatus.

SUMMARY

However, with the existing touch panel, information on a finger of theuser which can be detected by the touch panel was obtained only from astate of the finger of the user contacting the touch panel. For thisreason, it might be impossible to manipulate the apparatus until thefinger of the user came in contact with the touch panel. In addition,the user could not recognize what kind of processing was executed bycausing the finger to come in contact with the touch panel until theuser came in contact with the touch panel with his/her finger.

In addition, with the existing touch panel, only the state of the fingertouching the touch panel could be detected. Therefore, when themanipulation was carried out with the touch panel, it was difficult tomeasure how fast the finger came in contact with the touch panel.Likewise, it was also difficult to measure how fast the finger got awayfrom the touch panel. That is to say, heretofore, it was merely possibleto detect whether or not the finger came in contact with the touchpanel. Thus, there was such a restriction that the apparatus needed tobe manipulated by carrying out the input manipulation which could bedetermined from such a detection result.

The present disclosure has been made in order to solve the problemsdescribed above, and it is therefore desirable to provide a novel andimproved information processor which is capable of giving variety to aninput manipulation in a touch panel, an information processing method,and a computer program.

According to one exemplary embodiment, the disclosure is directed to aninformation processing apparatus including a detector that detectsmovement of a manipulation body in a vertical direction in relation to adisplay, and a processor that determines a speed of movement of themanipulation body based on an output of the detector, and determines aprocess to be executed based on the determined speed of movement.

According to another exemplary embodiment, the disclosure is directed toan information processing method performed by an information processingapparatus, the method comprising: detecting, by a detector of theinformation processing apparatus, movement of a manipulation body in avertical direction in relation to a display; determining, by a processorof the information processing apparatus, a speed of movement of themanipulation body based on an output of the detector; and determining,by the processor, a process to be executed based on the determined speedof movement.

According to another exemplary embodiment, the disclosure is directed toa non-transitory computer-readable medium including computer programinstructions, which when executed by an information processingapparatus, cause the information processing apparatus to perform aninformation processing method comprising: detecting movement of amanipulation body in a vertical direction in relation to a display;determining a speed of movement of the manipulation body based on anoutput of the detector; and determining a process to be executed basedon the determined speed of movement.

As set forth hereinabove, according to the present disclosure, it ispossible to provide the information processor which is capable of givingthe variety to the input manipulation in the touch panel, theinformation processing method, and the computer program.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a hardware configuration of aninformation processor according to a first embodiment of the presentdisclosure;

FIG. 2 is an explanatory perspective view showing a hardware structureof the information processor according to the first embodiment of thepresent disclosure;

FIG. 3 is an explanatory view showing a change in display expression ofan object when an amount of deformation of the object is changed inaccordance with a movement speed of a finger;

FIG. 4 is a block diagram showing a function and a configuration of theinformation processor of the first embodiment;

FIG. 5 is an explanatory view explaining processing for acquiringinformation on a movement speed of a finger in accordance with aproximate state of the finger, and a measurement time;

FIG. 6 is an explanatory view explaining processing for acquiring theinformation on the movement speed of the finger in accordance with theproximate state of the finger, and the measurement time;

FIG. 7 is an explanatory view explaining processing for acquiring theinformation on the movement speed of the finger in accordance with aproximate distance between a display surface and the finger;

FIG. 8 is an explanatory view explaining processing for acquiring theinformation on the movement speed of the finger when the movement speedof the finger in a direction vertical to the display surface cannot bedetected;

FIG. 9 is an explanatory view explaining the processing for acquiringthe information on the movement speed of the finger when the movementspeed of the finger in the direction vertical to the display surfacecannot be detected;

FIG. 10 is a flow chart explaining object manipulation controllingprocessing, in an information processing method according to a secondembodiment of the present disclosure, which is executed by theinformation processor of the first embodiment;

FIG. 11 is an explanatory view explaining a display expression changingmanipulation for moving an object in the back direction of a picture asan example of a change of the display expression of a GUI when a tappingoperation is carried out;

FIG. 12 is an explanatory view explaining an example in which when thesame object is selected in the case where objects are associated withpredetermined functions, respectively, a process for carrying out afunction with which the object is associated is changed in accordancewith the movement speed of the finger;

FIG. 13 is an explanatory view explaining an example in which processingcorresponding to the movement speed of the finger and utilizing adisplay area other than the object is executed;

FIG. 14 is an explanatory view explaining another example in which alayer picture is changed to another one by utilizing a display areaother than the object;

FIG. 15 is an explanatory view explaining still another example in whichthe layer picture is changed to another one by utilizing the displayarea other than the object;

FIG. 16 is an explanatory view explaining an example in which when thesame object is selected in the case where the objects are associatedwith the predetermined functions, respectively, the different functionsare carried out in accordance with the movement speed of the finger;

FIG. 17 is an explanatory view explaining contact position correctingprocessing executed in the information processor of the firstembodiment;

FIG. 18 is a flow chart explaining the contact position correctingprocessing executed in the information processor of the firstembodiment;

FIG. 19 is an explanatory view explaining an example of processing foracquiring information on a direction in which a user taps the displaysurface with his/her finger from the position information, anddetermining processing to be executed in accordance with the tappingdirection;

FIG. 20 is an explanatory view explaining another example of processingfor acquiring the information on the direction in which the user tapsthe display surface with his/her finger from the position information,and determining the processing to be executed in accordance with thetapping direction;

FIG. 21 is an explanatory view explaining an example of processing forchanging a display expression in a phase of selection of the object byutilizing the movement speed of the finger when the finger is releasedfrom the display surface;

FIG. 22 is an explanatory view explaining another example of processingfor changing the display expression in the phase of selection of theobject by utilizing the movement speed of the finger when the finger isreleased from the display surface;

FIG. 23 is an explanatory view explaining still another example ofprocessing for changing the display expression in the phase of selectionof the object by utilizing the movement speed of the finger when thefinger is released from the display surface; and

FIG. 24 is an explanatory view explaining yet another example ofprocessing for changing the display expression in the phase of selectionof the object by utilizing the movement speed of the finger when thefinger is released from the display surface.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present disclosure will be described in detailhereinafter with reference to the accompanying drawings. It is notedthat in the description and the drawings, constituent elements havingsubstantially the same functions and configurations are designated withthe same reference numerals, respectively, and a repeated descriptionthereof is omitted here for the sake of simplicity.

It is noted that the description will be given below in accordance withthe following order:

1. Outline of Information Processor;

2. Function and Configuration of Information Processor;

3. Object Manipulation Controlling Processing Using Movement SpeedInformation; and

4. Variation.

1. Outline of Information Processor

Hardware Configuration

Firstly, a hardware configuration of an information processor accordingto a first embodiment of the present disclosure will be described withreference to FIGS. 1 and 2. Note that, FIG. 1 is a block diagram showinga hardware configuration of an information processor 100 according tothe first embodiment of the present disclosure. FIG. 2 is an explanatoryperspective view showing a hardware structure of the informationprocessor 100 according to the first embodiment of the presentdisclosure.

The information processor 100 of the first embodiment is an apparatusincluding a detecting portion. In this case, the detecting portion candetect a contact position of a manipulation body on a display surface ofa display device, and also can detect a proximate distance between thedisplay surface of the display device, and the manipulation body locatedabove the display surface. Various apparatuses such as an apparatusincluding a small display device such as a personal digital assistanceor a smart phone are supposed as the information processor 100irrespective of the functions of the apparatuses. Further, the exemplaryembodiments discussed below show the manipulation body as being a user'sfinger. However, the manipulation body may also be any device used toinput operations to the apparatuses outlined above, such as a pen,stylus or any other similarly configured input instrument.

The information processor 100 of the first embodiment, as shown in FIG.1, includes a CPU 101, a Random Access Memory (RAM) 102, a non-volatilememory 103, a display device 104, and a proximate touch sensor 105.

The CPU 101 functions as an arithmetic operation processing unit and acontroller, and controls an overall operation of the informationprocessor 100 in accordance with various kinds of programs. In addition,the CPU 101 may also be a microprocessor. The RANI 102 temporarilystores therein a program which the CPU 101 uses in execution in the CPU101, parameters which are suitably changed in the execution in the CPU101, and the like. The CPU 101, the RAM 102, the non-volatile memory103, the display device 104, and the proximate touch sensor 105 areconnected to one another through a host bus composed of a CPU bus or thelike. The non-volatile memory 103 stores therein a program, arithmeticoperation parameters and the like which the CPU 101 uses. A Read OnlyMemory (ROM), a flash memory or the like, for example, can be used asthe non-volatile memory 103.

The display device 104 is an example of an output device for outputtinginformation. A Liquid Crystal Display (LCD) device, an Organic LightEmitting Diode (OLED) device, or the like, for example, can be used asthe display device 104. The proximate touch sensor 105 is an example ofan input device with which a user inputs information. Also, theproximate touch sensor 105 is composed of an input section through whichinformation is inputted, an input control circuit, and the like. In thiscase, the input control circuit generates an input signal in accordancewith an input manipulation made by the user and outputs the input signalthus generated to the CPU 101.

In the information processor 100 of the first embodiment, as shown inFIG. 2, the proximate touch sensor 105 is provided by being laminated ona display surface of the display device 104. As a result, when the usermoves his/her finger or the like closer to the display surface of thedisplay device 104, a distance between the display surface and thefinger can be detected by the proximate touch sensor 105.

Input of Manipulation Information to Information Processor

In such an information processor 100, when the user moves a manipulationbody such as his/her finger closer to the display surface of the displaydevice 104, the proximate distance between the display surface and themanipulation body is detected by the proximate touch panel 105. Theinformation processor 100 changes a display form of information beingdisplayed on the display device 104 in accordance with this proximatedistance. In this case, the information processor 100 of the firstembodiment acquires how fast the finger either comes in contact with theproximate touch panel 105 or comes to get away from the proximate touchpanel 105 as movement speed information. Also, the information processor100 of the first embodiment gives additional information to an inputmanipulation in accordance with the movement speed information. As aresult, the variety can be given to the input manipulation made by usingthe proximate touch panel 105.

For example, as shown in FIG. 3, it is assumed that a GUI of a button201 is displayed on the display device 104. When the proximate touchpanel 105 detects that the finger has come in contact with the displaysurface of the display device 104, the information processor 100 changesthe display expression in such a way that the button 201 is crushed by adepressing force of the finger. In this case, the information processor100 changes the display expression in such a way that an amount ofcrushing of the button 201 (that is, an amount of deformation) becomessmall when the movement speed of the finger is lower than apredetermined speed, and the amount of crushing of the button 201becomes large when the movement speed of the finger is equal to orhigher than the predetermined speed. In such a way, the amount ofcrushing of the button 201 is changed in accordance with the movementspeed of the finger in addition to such a change that the button 201 iscrushed when the finger comes in contact with the display surface,thereby making it possible to give the variety to the inputmanipulation.

The user can recognize the input manipulation recognized by theinformation processor 100 because the display expression of the GUI ischanged in accordance with the additional information. As a result, theoperability is enhanced by feedback of the manipulation input made bythe user himself/herself. In addition, the movement speed of the fingeris changed in such a way that the processing corresponding to the inputmanipulation is executed, whereby it is possible to select theprocessing to be executed. Hereinafter, a description will be given withrespect to a function and a configuration, and processing in theinformation processor 100 which can acquire information on the movementspeed of the finger with respect to the display surface, can change thedisplay expression of the GUI in accordance with the movement speed, andcan select the processing to be executed.

2. Function and Configuration of Information Processor

Firstly, the function and configuration of the information processor 100of the first embodiment will be described with reference to FIGS. 4 to9. Note that, FIG. 4 is a block diagram showing the function andconfiguration of the information processor 100 of the first embodiment.FIGS. 5 and 6 are respectively explanatory views explaining processingfor acquiring information on the movement speed of the finger inaccordance with a proximate state of the finger, and a measurement time.FIG. 7 is an explanatory view explaining processing for acquiring theinformation on the movement speed of the finger in accordance with theproximate distance between the display surface and the finger. Also,FIGS. 8 and 9 are respectively explanatory views explaining processingfor acquiring the information on the movement speed of the finger whenthe movement speed of the finger cannot be detected in a directionvertical to the display surface.

The information processor 100 of the first embodiment, as shown in FIG.4, includes an input displaying portion 110, a position informationacquiring portion 120, a movement speed acquiring portion 130, aprocessing determining portion 140, an execution processing portion 150,a display changing portion 160, and a setting storing portion 170.

The input displaying portion 110 is a functional portion for displayingthereon information, and inputting the information, and includes adetecting portion 112 and a displaying portion 114. The detectingportion 112 corresponds to the proximate touch sensor 105 shown inFIG. 1. An electrostatic touch panel or the like, for example, can beused as the detecting portion 112. In this case, the detecting portion112 detects a value of an electrostatic capacitance which is changed inaccordance with a proximate distance between the manipulation body and adisplay surface of the displaying portion 114.

When the manipulation body becomes close to the display surface of thedisplaying portion 114 by a predetermined distance or more, the value ofthe electrostatic capacitance detected by the detecting portion 112 isincreased. As the manipulation body becomes closer to the displaysurface of the displaying portion 114, the value of the electrostaticcapacitance thus detected is further increased. Also, when themanipulation body comes in contact with the display surface of thedisplaying portion 114, the value of the electrostatic capacitancedetected by the detecting portion 112 gets a maximum value. The positioninformation acquiring portion 120 which will be described later canacquire position information on the manipulation body with respect tothe display surface of the displaying portion 114 in accordance withsuch a value of the electrostatic capacitance detected by the detectingportion 112. The detecting portion 112 outputs the value of theelectrostatic capacitance thus detected as a detection result to theposition information acquiring portion 120.

The displaying portion 114 is an output device, for displaying thereoninformation, which corresponds to the display device 104 shown inFIG. 1. A GUI object, a matter of contents associated with the GUIobject, and the like, for example, are displayed on the displayingportion 114. In addition, when a display form of the object is changedto another one by the display changing portion 160, an object aftercompletion of the change of the display form is displayed on thedisplaying portion 114 in accordance with display change information, onthe object, of which the displaying portion 114 is informed from thedisplay changing portion 160.

The position information acquiring portion 120 acquires positioninformation representing a positional relationship between themanipulation body and the display surface of the displaying portion 114in accordance with a detection result inputted thereto from thedetecting portion 112. As described above, the manipulation body and thedisplay surface of the displaying portion 114 are close to each other asthe value of the electrostatic capacitance detected by the detectingportion 112 is larger. Thus, when the manipulation body comes in contactwith the display surface of the displaying portion 114, the value of theelectrostatic capacitance detected by the detecting portion 112 gets themaximum value. Information on a correspondence relationship between thevalue of the electrostatic capacitance, and the proximate distance (or aproximate detection area) is previously stored in the setting storingportion 170 which will be described later. The position informationacquiring portion 120 acquires information on a position of the fingerin a direction (in a z-axis direction) vertical to the display surfaceby referring to the setting storing portion 170 in accordance with thevalue of the electrostatic capacitance inputted thereto from thedetecting portion 112.

In addition, the position information acquiring portion 120 specifiesthe position of the manipulation body on the display surface of thedisplaying portion 114 (that is, on an xy-plane) in accordance with thedetection result inputted thereto from the detecting portion 112. Forexample, it is assumed that the detecting portion 112 is composed of anelectrostatic sensor substrate in which electrostatically detectinggrids for detecting an x-coordinate and a y-coordinate are formed. Atthis time, the detecting portion 112 can specify the position of themanipulation body on the electrostatic sensor substrate (that is, on thedisplay surface) from a change in value of the electrostaticcapacitance, in each of the grids, corresponding to the contact of themanipulation body. For example, the coordinate position whose value ofthe electrostatic capacitance is largest can be specified as thecoordinates of the position where the finger comes to be closest to thedisplay surface of the displaying portion 114. Or, the position of thecenter of gravity of the area in which the value of the electrostaticcapacitance equal to or larger than a predetermined value is detectedcan be specified as the coordinates of the position where the fingercomes to be closest to the display surface of the displaying portion114.

In such a way, the position information acquiring portion 120 canacquire the position information on the manipulation body with respectto the display surface of the displaying portion 114. The positioninformation on the manipulation body thus acquired is outputted from theposition information acquiring portion 120 to each of the measurementspeed acquiring portion 130 and the processing determining portion 140.

The movement speed acquiring portion 130 acquires movement speedinformation representing the movement speed of the finger with respectto the display surface of the displaying portion 114. A method ofacquiring the movement speed information can be determined in accordancewith acquirable information by the detecting portion 112. Here, themethod of acquiring the movement speed information will be describedwith reference to FIGS. 5 to 9.

Acquisition of Movement Speed Information

Firstly, when the proximate distance between the display surface of thedisplaying portion 114, and the finger in the direction vertical to thedisplay surface of the displaying portion 114 cannot be acquired inaccordance with the detection result acquired from the detecting portion112, the movement speed acquiring portion 130 measures a period of timeuntil the finger for which a predetermined proximate state is detectedcomes in contact with the display surface, thereby making it possible toacquire the measurement speed of the finger. Here, it is assumed thatthe predetermined proximate state is obtained when the finger is locatedin a position which is located at a proximate detection distance, d,from the display surface. For example, when the finger is moved closerto the display surface, and a tapping operation is carried out with thefinger, as shown in FIG. 5, a movement speed V_(tap) of the finger canbe acquired from Expression (1) by using a difference between a time(contact detection time t_(touch)) until the finger comes to contact thedisplay surface and a time (proximate state detection time t_(hover)) atwhich the proximate state is detected, and the proximate detectiondistance d:V _(tap) =d/(t _(hover) −t _(touch))  (1)

Likewise, when an operation for causing the finger to get away from thedisplay surface is carried out, as shown in FIG. 6, a movement speedV_(release) of the finger can be acquired from Expression (2) by using adifference between a time (proximate state release detection timet_(hoverRelease)) at which the proximate state of the finger is releasedand a time (contact release detection time t_(release)) at which thecontact state of the finger with respect to the display surface, and theproximate detection distance d:V _(release) =d/(t _(hoverRelease) −t _(release))  (2)

In addition, when the proximate distance between the display surface ofthe displaying portion 114, and the finger in the direction vertical tothe display surface of the displaying portion 114 can be acquired inaccordance with the detection result acquired from the detecting portion112, as shown in FIG. 7, the movement speed acquiring portion 130 canacquire a movement speed V(t) of the finger by carrying out timedifferential calculus about a proximate distance Z(t). That is to say,the movement speed V(t) can be expressed by Expression (3):V(t)=dZ(t)/dt  (3)

However, when the movement speed of the finger in the direction verticalto the display surface cannot be detected, a movement vector of thefinger on the xy-plane may be acquired and a speed vector acquired byusing the movement vector may be made the movement speed of the fingerin the vertical direction. For example, as shown in FIG. 8, when thefinger is moved closer to the display surface to carry out a tapmanipulation, V_(x)(t) as a time differential value of a movementdistance x(t) in an x-direction, and V_(y)(t) as a time differentialvalue of a movement distance y(t) in a y-direction are both acquired.Also, the movement vector calculated from the movement vector of thefinger on the xy-plane is acquired as VZ(t). In the case as well wherean operation for causing the finger to get away from the display surfaceas shown in FIG. 9, likewise, the movement vector calculated from themovement vector of the finger on the xy-plane can be acquired as VZ(t).

It is noted that whether the finger comes in contact with the displaysurface or is caused to get away from the display surface can bedetermined in accordance with the magnitude of the electrostaticcapacitance value detected by the detecting portion 112.

In such a way, the movement speed acquiring portion 130 acquires themovement speed information representing the movement speed of the fingerwith respect to the display surface of the displaying portion 114, andoutputs the movement speed information thus acquired to the processingdetermining portion 140.

Referring back to FIG. 4, the processing determining portion 140determines the display form of the object being displayed on thedisplaying portion 114, the execution of the processing (function)associated with the object, and the like in accordance with the positioninformation and the movement speed information on the finger. Theprocessing determining portion 140 specifies the object being displayedin the position corresponding to the position information of the finger,and determines the processing associated with the object, and the changeof the display expression of the object in accordance with the movementspeed information. In this case, the movement speed information is usedas the additional information. Thus, the processing determining portion140 can change the display expression in accordance with the movementspeed of the finger, and can select the processing to be executed inaccordance with the movement speed information. The processingdetermining portion 140 outputs the contents of the processingdetermined to at least one of the execution processing portion 150 orthe display changing portion 160.

The execution processing portion 150 executes the processing associatedwith the object in accordance with the contents of the processingdetermined by the processing determining portion 140. The functioncorresponding to the manipulation input is carried out by the executionprocessing portion 150.

The display changing portion 160 changes the display information beingdisplayed on the displaying portion 114 in accordance with the contentsof the processing determined by the processing determining portion 140.The display changing portion 160, for example, generates an image forchanging of the display shape of the object, or changing of the objectbeing displayed, and outputs the information on the image to thedisplaying portion 114.

The setting storing portion 170 calculates the proximate distancebetween the manipulation body and the display surface, and generates theposition information on the manipulation body on the display surface. Inaddition thereto, the setting storing portion 170 stores thereininformation which is used during the processing for changing the displayform of the object as setting information. The setting storing portion170, for example, stores therein information on a correspondencerelationship between the values of the electrostatic capacitances, andthe proximate distances. The position information acquiring portion 120can acquire the information on the position corresponding to the valueof the electrostatic capacitance inputted thereto from the detectingportion 112 by referring to such a correspondence relationship. Inaddition, the contents of the processing corresponding to themanipulation input which is carried out for the object by the user arestored in the setting storing portion 170. The setting informationstored in the setting storing portion 170 either may be previouslystored, or may be set by the user.

It is noted that the information processor 100 of the first embodimentmay include a memory and the like for temporarily storing thereininformation necessary for the processing for changing the display formof the object and the like.

3. Object Manipulation Controlling Processing Using Movement SpeedInformation

The information processor 100 of the first embodiment can acquire boththe information on the position of the finger with respect to thedisplay surface, and the information on the movement speed of the fingerwith respect to the display surface because it includes the functiondescribed above. The information processor 100 controls the informationon the object manipulation being displayed on the displaying portion 114by using these pieces of information, thereby making it possible to givethe variety to the manipulation input to the information processor 100.Hereinafter, object manipulation controlling processing, in aninformation processing method according to a second embodiment of thepresent disclosure, which is executed by the information processor 100of the first embodiment will be described with reference to FIG. 10.Here, FIG. 10 is a flow chart explaining the object manipulationcontrolling processing, in the information processing method accordingto the second embodiment of the present disclosure, which is executed bythe information processor 100 of the first embodiment.

When the finger either is moved closer to or comes in contact with thedisplay surface of the displaying portion 114 and thus a change inelectrostatic capacitance value is detected by the detecting portion112, the position information acquiring portion 120 of the informationprocessor 100 acquires the information on the position of the fingerwith respect to the display surface (S100). For example, when thedetecting portion 112 is composed of the electrostatic sensor substrateon which the electrostatically detecting grids for detecting thex-coordinate and the y-coordinate are formed, as described above, theposition information acquiring portion 120 may determine either thecoordinate position having the largest electrostatic capacitance value,or the position of the center of gravity of the area in which theelectrostatic capacitance value equal to or larger than thepredetermined value is detected as the coordinates, on the xy-plane, ofthe position where the finger is closest to the display surface.

In addition, the position information acquiring portion 120 acquires theinformation as well on the position in the direction (in thez-direction) vertical to the display surface. The information on theposition of the finger in the z-direction differs depending on theinformation which can be detected by the detecting portion 112. Forexample, when the proximate distance from the display surface to thefinger can be acquired by the detecting portion 112, the proximatedistance gives the position information in the z-direction. In addition,when the detecting portion 112 can detect that the finger is locatedwithin an area (proximate detection area) between the display surfaceand the position located at the proximate detection distance, d, fromthe display surface, the position information in the z-direction becomesinformation as to whether or not the finger exists in the proximatedetection area, and whether or not the finger contacts the displaysurface.

It is noted that even when the information on the position of the fingerin the z-direction cannot be acquired by the detecting portion 112, itis possible to execute the object manipulation controlling processingshown in FIG. 10. Therefore, in Step S100, it is only necessary to becapable of acquiring at least the position of the finger on thexy-plane. The position information acquiring portion 120 outputs theposition information thus acquired to each of the movement speedacquiring portion 130 and the processing determining portion 140.

Next, the movement speed acquiring portion 130 acquires the movementspeed information representing the movement speed of the finger inaccordance with the position information inputted thereto from theposition information acquiring portion 120 (S110). Here, the movementspeed information has only to contain at least the information on themeasurement speed in the vertical direction to the display surface, thatis, in the z-direction. Also, the measurement speeds of the finger inthe x-direction and in the y-direction have to be acquired only whenthey become necessary for the determination processing executed by theprocessing determining portion 140. The movement speed of the finger inthe z-direction can be acquired by using the position informationacquired in Step S100 In this case, as described above, the movementspeed acquiring portion 130 suitably carries out the method by usingwhich the movement speed in the z-direction can be acquired inaccordance with the information contained in the position information,thereby acquiring the movement speed information. The movement speedacquiring portion 130 outputs the movement speed information thusacquired to the processing determining portion 140.

In addition, the processing determining portion 140 determines theprocessing which is to be executed by the manipulation input made by theuser in accordance with both position information and the movement speedinformation on the finger (S120). In Step S120, in addition to theinformation on the basic motions, of the finger, such as the tappingoperation and the scroll motion, the information on the movement speedof the finger is utilized as the additional information, therebydetermining the contents of the processing which is to be executed bythe manipulation input made by the user (S130, S140).

For example, as shown in FIG. 3, when the GUI of the button 201 isdisplayed on the displaying portion 114, and the user contacts theposition where the button 201 is displayed with his/her finger, thedisplay expression of the button 201 is changed to the displayexpression in which the button 201 is crushed. At this time, theprocessing determining portion 140 determines whether or not themovement speed of the finger is higher (larger) than a predeterminedspeed (threshold value) by referring to the setting storing portion 170(S120). Also, when it is determined in Step S120 that the movement speedof the finger is higher than the predetermined speed (YES), theprocessing determining portion 140 compares this case with the casewhere the movement speed of the finger is equal to or lower than thepredetermined speed, thereby increasing the amount of crushing of thebutton 201 (S130: first processing). On the other hand, when it isdetermined in Step S120 that the movement speed of the finger is equalto or lower than the predetermined speed (NO), the display expression ischanged in such a way that the button 201 is crushed by an amount ofreference crushing of the button 201 previously set (S140: secondprocessing).

In such a way, the processing determining portion 140 can determine anamount of crushing of the button 201 in accordance with the movementspeed of the finger, and can change the display expression of the GUI inaccordance with the movement speed of the finger. The processingdetermining portion 140 outputs the contents of the processing thusdetermined to at least one of the execution processing portion 150 orthe display changing portion 160 (S150) Since in the case of FIG. 3, thedisplay expression of the button 201 is changed to another one inaccordance with the movement speed of the finger, the contents of theprocessing are outputted to at least the display changing portion 160.The display changing portion 160 changes the GUI in such a way that thebutton 201 is crushed by an amount of crushing of the button 201determined in the processing determining portion 140, and outputsinformation on the GUI thus changed to the displaying portion 114. Insuch a way, the user can visually recognize the manipulation inputdepending on the difference in movement speed of the finger.

It is noted that when the button 201 is associated with the differentpieces of processing in correspondence to the difference in movementspeed of the finger, the contents of the processing determined by theprocessing determining portion 140 are outputted to the executionprocessing portion 150. The execution processing portion 150 executesthe processing with which the button 201 is associated in accordancewith the processing contents. As a result, the user can also select theprocessing to be executed by changing the movement speed of the finger.

The description has been given so far with respect to the objectmanipulation controlling processing, using the movement speedinformation in the information processing method of the secondembodiment, which is executed by the information processor 100 of thefirst embodiment. According to the second embodiment of the presentdisclosure, when it is detected that the user carries out the operationfor tapping the display surface with his/her finger in accordance withthe detection result acquired from the detecting portion 112, theprocessing determining portion 140 determines the contents of theprocessing to be executed in accordance with the movement speed of thefinger when the tapping operation is carried out. As a result, it ispossible to give the variety to the input manipulation in the touchpanel.

4. Variation

The object manipulation controlling processing, in the informationprocessing method of the second embodiment, which is executed by theinformation processor 100 of the first embodiment can also be applied tocases other than the case of the changing of the display expression ofthe GUI as shown in FIG. 3. Hereinafter, examples of application of theobject manipulation controlling processing, in the informationprocessing method of the second embodiment, which is executed by theinformation processor 100 of the first embodiment will be described inorder. It is noted that in the following description, the movement speedof the finger means the movement speed of the finger in the verticaldirection (that is, in the z-direction) to the display surface of thedisplaying portion 114 except for the case where the special mention ismade.

Expression Change of GUI: Display Sinking in Back Direction

FIG. 11 is an explanatory view explaining the display expressionchanging processing for moving the object in the back direction of apicture as an example of the change of the display expression of the GUIwhen the tapping operation is carried out. In this case, when themovement speed of the finger with which the tapping operation is carriedout for the display surface is higher than the predetermined speed, theobject can be moved in the back direction of the picture. As shown inFIG. 11, it is assumed that an object group 202 composed of pluralobjects is displayed on the displaying portion 114. In a state of notreceiving the manipulation input, the plural objects in the object group202 are disposed on the same surface parallel with the display surfaceof the displaying portion 114.

It is assumed that the tapping operation is carried out, for example,for the object 202 a of the plural objects in the object group 202. Theprocessing determining portion 140 detects that a manipulation isdesired to be carried out for the object 202 a in accordance with theposition information acquired from the position information acquiringportion 120. Also, the processing determining portion 140 acquires theinformation on the movement speed of the finger with which the tappingoperation is carried out from the movement speed acquiring portion 130by utilizing the information processing method of the second embodimentdescribed above. When it is determined that the movement speed of thefinger is equal to or lower than the predetermined speed, the displayexpression of the object 202 a is not changed. On the other hand, whenit is determined that the movement speed of the finger is higher thanthe predetermined speed, the processing determining portion 140determines that the display expression is changed in such a way that theobject 202 a which the finger is desired to contact is processed to sinkin the back of the picture by the finger movement force. The informationon the processing contents to be changed is assumed to be stored in thesetting storing portion 170.

The processing determining portion 140 outputs the processing contentsdetermined to the display changing portion 160. The display changingportion 160 changes the display information in such a way that theobject 202 a being displayed on the displaying portion 114 sinks in theback of the picture in accordance with the processing contents. Also,the display changing portion 160 causes the displaying portion 114 todisplay thereon the display information after completion of the changingof the display information. In such a way, as shown in FIG. 11, thedisplay expression of the object 202 a is changed. In such a way, thedisplay expression of the object is changed in accordance with themovement speed of the finger with which the tapping operation is carriedout, whereby the user can visually recognize what kind of manipulationinput has been carried out. In addition, when the object is associatedwith the predetermined processing, the processing to be executed canalso be changed in accordance with the movement speed of the finger withwhich the object is desired to be selected. As a result, the processingto be executed can be selected in accordance with the movement speed ofthe finger with which the tapping operation is carried out.

Execution of Processing Corresponding to Movement Speed of Finger(Function Performance Confirmation)

When the same object is selected in the case where the object isassociated with a predetermined function, a process for carrying out thefunction associated with the object concerned can also be changed inaccordance with the movement speed of the finger. In an example shown inFIG. 12, the function associated with the object concerned is carriedout by tapping a desired object with the finger. For example, the object202 a in the object 202 is tapped with the finger, an object 203 isdisplayed on the displaying portion 114.

When the processing determining portion 140 detects that the object 202a has been tapped with the finger in accordance with the positioninformation acquired by the position information acquiring portion 120,the processing determining portion 140 determines whether or not themovement speed of the finger the information on which is acquired by themovement speed acquiring portion 130 is higher than the predeterminedspeed. Also, when it is determined that the movement speed of the fingeris equal to or lower than the predetermined speed, the processingdetermining portion 140 does not cause the displaying portion 114 tochange the display expression of the object 202 a, but confirms right orwrong as to carrying-out of the function associated with the object 202a. The right or wrong as to carrying-out of the function, for example,can be carried out in the form of pop-up display, a sound or the like.Also, when the user permits the function to be carried out, the functionis carried out, and the object 203 is displayed on the displayingportion 114.

On the other hand, when it is determined that the movement speed of thefinger is higher than the predetermined speed, the processingdetermining portion 140 causes the display changing portion 160 tochange the display expression of the object 202 a in such a way that theobject 202 a sinks in the back of the picture. Also, the processingdetermining portion 140 carries out directly the function associatedwith the object 202 a and causes the displaying portion 114 to displaythereon the object 203 by using the display changing portion 160 withoutconfirming whether the carrying-out of the function is right or wrongfrom the user.

In such a way, the process for carrying out the function associated withthe object can be determined in accordance with the movement speed ofthe finger with which the object is desired to be selected. For example,when the function is desired to be directly carried out withoutdisplaying a message for confirming whether the carrying-out of thefunction is right or wrong from the user, it is only necessary for theuser to quickly move his/her finger to carry out the tapping operation.

Execution of Processing Corresponding to Movement Speed of Finger(Utilization of Display Area Other than Object)

In the case where the object is associated with the predeterminedfunction, normally, even when the user touches the display area otherthan the object with his/her finger, no reaction occurs at all. With theinformation processor 100 of the first embodiment, when it is detectedthat the tapping operation is carried out in the display area other thanthe object at the speed higher than the predetermined speed by utilizingthe function capable of acquiring the information on the movement speedof the finger, it is also possible to change a layer picture from thelayer picture which is currently displayed on the displaying portion 114to a next layer picture.

For example, as shown in FIG. 13, it is assumed that the object group202 composed of the object 202 a, etc. is displayed on a first layerpicture 210. The objects are associated with the predeterminedfunctions, respectively, and the desired object is tapped with thefinger, thereby making it possible to carry out the function with whichthe desired object is associated. On the other hand, even when thetapping operation is carried out in the display area other than theobject at the speed equal to or lower than the predetermined speed, somesort of function is not carried out, and also the display contents ofthe displaying portion 114 are not changed at all.

However, when the tapping operation is carried out in the display areaother than the object at the speed higher than the predetermined speed,for example, as shown in FIG. 13, the layer picture is changed from thefirst layer picture 210 in which the object group 202 has been displayedto a second layer picture in which an object group 204 is displayed.Referring to FIG. 13, the layer picture is changed in such a way thatthe first layer picture 210 is moved so as to lightly fall in the backof the picture, thereby displaying the second layer picture 220.

In such a way, when the movement speed of the finger with which thedisplay area is tapped is higher than the predetermined speed, thefunction of carrying out the layer picture changing manipulation iscarried out by utilizing the display area other than the object. Theuser can intuitively carry out the layer picture changing manipulation.In addition, the layer picture changing function is carried outexclusively only in the case where the movement speed of the finger ishigher than the predetermined speed. Therefore, even if the display areaother than the object is tapped with the finger by mistake when theobject is desired to be tapped with the finger, in the case where themovement speed of the finger is equal to or lower than the predeterminedspeed, the layer picture changing function is not carried out, and thusthe malfunction can be prevented from being caused.

FIGS. 14 and 15 show other examples in each of which the layer pictureis changed to another one by utilizing the display area other than theobject. In each of the examples shown in FIGS. 14 and 15, respectively,when the display area other than the object is tapped with the finger,the layer picture 210 is rotated. In this case, the layer picture ischanged in such a way that when the layer picture 210 is rotated by180°, the second layer picture 220 is displayed.

For example, as shown in FIG. 14, input areas 205 a and 205 b in each ofwhich the manipulation input for carrying out the layer picture changingis received are set in the display area other than the object. The inputareas 205 a and 205 b, for example, can be provided in both ends of thedisplay area, respectively. When the user moves his/her finger at themovement speed higher than the predetermined speed to carry out thetapping operation for the input area 205 a, the layer picture 210 isrotated in a clockwise direction in such a way that the layer picture210 is rotated by a depressing force of the finger. Also, the layerpicture is changed in such a way that when the first layer picture 210is rotated by 180°, for example, the second layer picture 220A isdisplayed in which the object 204A is being displayed.

In addition, as shown in FIG. 15, when the user moves his/her finger atthe movement speed higher than the predetermined speed to carry out thetapping operation for the input area 205 b, the layer picture 210 isrotated in a counterclockwise direction in such a way that the layerpicture 210 is rotated by the depressing force of the finger. Also, thelayer picture is changed in such a way that when the first layer picture210 is rotated by 180°, the second layer picture 220B is displayed inwhich the object 204B is being displayed.

In such a way, the layer picture is changed in such a way that the layerpicture is rotated in which the object is being displayed, whereby theuser can intuitively carry out the layer picture changing manipulation,and can receive the change in picture without feeling an unpleasantsensation. It is noted that even when the tapping operation is carriedout in an area, other than the input areas 205 a and 205 b, of thedisplay area other than the object, some sort of function is not carriedout, and the display contents of the displaying portion 114 is notchanged at all. Likewise, even when the tapping operation is carried outin such an area at the movement speed equal to or lower than thepredetermined speed, some sort of function is not carried out, and thedisplay contents of the displaying portion 114 is not changed at all. Asa result, the malfunction can be prevented from being caused.

Execution of Processing Corresponding to Movement Speed of Finger(Carrying-Out of Different Functions)

With the information processor 100 of the first embodiment, when thesame object is selected in the case where the objects are associatedwith the predetermined functions, respectively, different functions canalso be carried out in accordance with the movement speed of the finger.For example, as shown in FIG. 16, it is assumed that the object group202 composed of the plural objects is displayed on the displayingportion 114. The desired object is tapped with the finger, whereby thefunction associated with the desired object is carried out. At thistime, one object is associated with plural functions which are carriedout in accordance with the movement speeds of the finger, respectively,with which the object concerned is tapped.

For example, as shown in FIG. 16, when the object 202 a is tapped withthe finger at the movement speed equal to or lower than thepredetermined speed (normal tap), the processing determining portion 140causes a normal function associated with the object 202 a to be carriedout. On the other hand, when the object 202 a is tapped with the fingerat the movement speed higher than the predetermined speed (speedilytap), the processing determining portion 140 causes the object group 204to be developed into a list so as to display all of the objects whichare contained in the object 202 a concerned. In such a way, the movementspeed of the finger with which the same object is tapped is changed,whereby the different manipulations can be allocated, and thus theoperability can be enhanced.

For example, when the contents such as photographs and images aregrouped depending on a date and a content, the object group 202 havingtypical contents of the groups as the objects is shown. Also, when thenormal tap is carried out for any one of the objects composing theobject group 202 at the movement speed equal to or lower than thepredetermined speed, the typical contents are selected. On the otherhand, when the tapping operation is carried out for any one of theobjects composing the object group 202 at the movement speed higher thanthe predetermined speed, an object group 204 composed of the contentsbelonging to the same group as that of the typical contents is displayedin the form of a list. In such a way, when the objects are hierarchized,the movement speed of the finger with which the object is tapped ischanged, whereby the hierarchy to be displayed can be changed, and thedesired contents can also be carried out.

Contact Position Correcting Processing

As described above, the information processor 100 of the firstembodiment changes the display expression of the GUI, and the processingto be executed in accordance with the movement speed of the finger withwhich the object is tapped. At this time, when the movement speed of thefinger is too high, the possibility that the object which the user doesnot intend to tap the display surface with his/her finger is determinedto be tapped becomes large, and thus it is feared to cause themalfunction. In order to cope with such a situation, with theinformation processor 100 of the first embodiment, the position wherethe finger contacts the object can also be corrected in accordance withthe movement speed of the finger. Hereinafter, the contact positioncorrecting processing executed in accordance with the movement speed ofthe finger will be described with reference to FIGS. 17 and 18. Here,FIG. 17 is an explanatory view explaining the contact positioncorrecting processing executed in the image processor 100 of the firstembodiment. Also, FIG. 18 is a flow chart explaining the contactposition correcting processing executed in the image processor 100 ofthe first embodiment.

As shown in FIG. 17, it is assumed that an object 206 which is dividedinto plural areas is displayed on the displaying portion 114. The usermoves his/her finger closer to the object 206, whereby it is possible tofocusing an area corresponding to the position to which his/her fingeris moved closer. In FIG. 17, an area 206 a of the object 206 is focused.When from such a state, the user moves his/her finger onto the displaysurface of the displaying portion 114 to cause his/her finger to come incontact with a part of the object 206, the area of the object 206selected is corrected in accordance with the movement speed of thefinger.

When the movement speed of the finger is higher than the predeterminedspeed, the precision of the manipulation for selection using the fingeris reduced, a position different from the desired position is easy toselect. Then, with the information processor 100 of the firstembodiment, it is assumed that when the movement speed of the fingerwith which the tapping operation is carried out is equal to or lowerthan the predetermined speed, the focused area located in the positionwhich the finger contacts is selected. In FIG. 17, an area 206 b whichthe finger contacts is selected. On the other hand, it is assumed thatwhen the movement speed of the finger with which the tapping operationis carried out is higher than the predetermined speed, the area locatedin the position which the finger contacts is not selected, but the areawhich has been focused right before the contact of the finger isselected. That is to say, the area 206 b which the finger contacts isnot regarded as being selected, but an area 206 a which has been focusedright before the contact of the finger is regarded as being selected.

More specifically, the processing determining portion 140 of theinformation processor 100 determines whether or not the finger islocated in the proximate detection area in accordance with the positioninformation acquired by the position information acquiring portion 120(S200). When it is determined in S200 that the finger is not located inthe proximate detection area (NO), processing in Step S200 isrepetitively executed. On the other hand, when it is determined in S200that the finger is located in the proximate detection area (YES), theprocessing determining portion 140 causes the display changing portion160 to focus the area of the object 206 corresponding to the position ofthe finger (S210).

After that, the processing determining portion 140 determines whether ornot the finger has come in contact with the display surface of thedisplaying portion 114 (S220). When it is determined in Step S220 thatthe finger has not come in contact with the display surface (NO), thethree pieces of processing from S200 to S220 are repetitively executed.On the other hand, when it is determined in Step S220 that the fingerhas come in contact with the display surface (YES), the processingdetermining portion 140 determines whether or not the measurement speedof the finger the information on which is acquired by the movement speedacquiring portion 130 is higher than the predetermined speed (thresholdvalue)(S230). Also, when it is determined in Step S230 that themeasurement speed of the finger is higher than the predetermined speed(YES), as shown in a top right part of FIG. 17, the area which has beenfocused right before the contact of the finger is regarded as beingselected (S240). That is to say, the area to be selected is correctedfrom the area corresponding to the position with which the finger comesin contact to the area which has been focused right before the contactof the finger, and the function associated with the area concerned iscarried out. Here, the area which has been focused right before thecontact of the finger means the area corresponding to the position whichhas been detected right before the contact of the finger when theproximate distance from the display surface to the finger can bedetected, and means the area corresponding to the position of the fingerwhen the finger has entered the proximate detection area when theproximate distance cannot be detected.

On the other hand, when it is determined in Step S230 that the movementspeed of the finger is equal to or lower than the predetermined speed(NO), as shown in a bottom right part of FIG. 17, the area correspondingto the position with which the finger comes in contact is selected(S250). As a result, when the manipulation is carried out for the GUIhaving a much smaller size than that of the finger, the user slowly tapsthe object with his/her finger, whereby it becomes possible to preciselyselect the desired area.

Execution of Processing Corresponding to Direction of Tap

The information processor 100 of the first embodiment can acquireinformation on the position of the finger with respect to the displaysurface of the displaying portion 114 by using the position informationacquiring portion 120. Then, information on the direction in which thedisplay surface is tapped with the finger may be acquired from theposition information, and the processing to be executed may bedetermined in accordance with the direction in which the display surfaceis tapped with the finger.

For example, as shown in FIG. 19, it is assumed that an object group 207composed of pile-shaped objects 207 a, 207 b, . . . is displayed on thedisplaying portion 114. For the purpose of confirming the contacts withthe objects 207 a, 207 b, . . . composing the object group 207, it isnecessary to develop the object group 207. In this case, however, how todevelop the object group 207 can be changed in accordance with the tapdirection of the finger for manipulation of the object group 207.

For example, when the user taps the object group 207 with his/her fingerwhile he/she obliquely moves his/her finger, the object group 207 isdeveloped into the pile-shaped objects 207 a, 207 b, . . . which arepiled one upon another along the movement direction of the finger so asfor the pile-shaped objects 207 a, 207 b, . . . to be slid (slidedevelopment). Also, when one object (for example, the object 207 d) isselected from the object group 207 thus developed through the tappingoperation, the processing associated with the object 207 is executed.

On the other hand, when the user taps the object group 207 with his/herfinger by moving his/her finger in the direction approximately verticalto the display surface of the displaying portion 114, the objects 207 a,207 b, . . . composing the object group 207 are displayed in the form ofa list so that all of the objects 207 a, 207 b, . . . can be visualizedfor the user. Also, when one object (for example, the object 207 d) isselected from the object group 207 displayed in the form of the listthrough the tapping operation similarly to the case of the slidedevelopment, the processing associated with the object 207 d isexecuted.

In such a way, how to develop the object group 207 is changed inaccordance with the movement direction of the finger with which the usertaps the object group 207, whereby the object group 207 can be developedwithout an unpleasant sensation for the user.

In addition, when the object group developed through the slidedevelopment as shown in FIG. 19 is further associated with pluralobjects, the objects lying in a lower hierarchy may be slide-developedin accordance with the measurement direction of the finger with whichthe objects lying in an upper hierarchy are tapped. It is assumed thatas shown in a state (A) of FIG. 20, an object group 208 composed ofplural objects 208 a, 208 b, . . . is developed in a line. At this time,when the user taps the object 208 a with his/her finger while he/sheobliquely moves his/her finger, as shown in a state (B) of FIG. 20,objects a1, a2, and a3 which lie in a lower hierarchy with respect tothe object 208 a are developed along the movement direction of thefinger. As a result, the object group 208 can be developed without anunpleasant sensation for the user.

Selection of Object Corresponding to Movement Speed of Finger

The information processor 100 of the first embodiment can acquireinformation on a movement speed as well of the finger when the finger isreleased from the display surface of the displaying portion 114similarly to the case where the information on the movement speed of thefinger when the display surface is tapped with the finger is acquired.The display expression in the phase of selection of the desired objectcan be changed by utilizing the movement speed of the finger when thefinger is released from the display surface, and thus the user can benotified of the selection state of the desired object in the expressionwhich is visually easy-to-follow.

For example, it is considered that the object is set in the selectionstate when the movement speed of the finger in the phase of release ofthe finger from the display surface is higher than the predeterminedspeed. As shown in FIG. 21, it is assumed that an object group 209composed of plural objects 209 a is displayed on the displaying portion114. The user release his/her finger from the display surface of thedisplaying portion 114 at the speed higher than the predetermined speed,thereby making it possible to collectively select the object group 209.That is to say, when the movement speed of the finger is equal to orlower than the predetermined speed, the object group 209 is not set inthe selection state. As shown in FIG. 21, the processing determiningportion 140 causes the display changing portion 160 to display such astate so that after a lapse of predetermined time, the floating objectgroup 209 returns back to the original steady state after it has causedthe display changing portion 160 to express such a state so that theobject group 209 floats so as to follow the releasing operation of thefinger.

On the other hand, when the movement speed of the finger is higher thanthe predetermined speed, as shown in FIG. 22, the processing determiningportion 140 causes the display changing portion 160 to express such astate so that the object group 209 floats along with the releasingoperation of the finger. Also, even when the finger gets away from theproximate detection area, or a predetermined time elapses after thedisplay state of the object group 209 was changed, the floatingexpression of the object group 209 is left as it is. By adopting such afashion in which a wind or a wind pressure is expressed in the form ofmetaphor, the user can be visually notified of that the object group 209is held in the selection state in an easy-to-understand manner.

In addition, contrary to the examples of FIGS. 21 and 22, when themovement speed of the finger when the finger is released from thedisplay surface is equal to or lower than the predetermined speed, theobject group 209 may be set in the selection state. In this case,fishing is expressed in the form of the metaphor. That is to say, whenthe movement speed of the finger is equal to or lower than thepredetermined speed, as shown in FIG. 23, the processing determiningportion 140 causes the display changing portion 160 to carry out theexpression in such a way that the object group 209 floats along with thereleasing operation of the finger. In addition, when the finger isreleased from the display surface, the object group 209 is alsoexpressed so as to float from the position in the steady state and fromthe display surface. In such a way, the object group 209 is expressed inthe floating state, whereby it is possible to show that the object group209 is held in the selection state.

On the other hand, when the movement speed of the finger is higher thanthe predetermined speed, as shown in FIG. 24, the processing determiningportion 140 causes the display changing portion 160 to carry out theexpression in such a way that the object group 209 floats along with thereleasing operation of the finger. After that, the processingdetermining portion 140 causes the display changing portion 160 to carryout the display in such a way that after a lapse of predetermined time,the floating object group 209 returns back to the original steady state.In such a way, the object group 209 is set in the selection state, andthus the user can be visually notified of that the object group 209 isheld in the selection state in the easy-to-understand manner.

Note that, in the examples of FIGS. 21 to 24, for the purpose ofreleasing the selection state of the object group 209, for example, itis only necessary to carry out the manipulation inputting operation forcausing the finger to come in contact with the object group 209 held inthe selection state.

The description has been given so far with respect to the informationprocessing method, using the additional information as to the movementspeed of the finger, of the second embodiment executed by theinformation processor 100 of the first embodiment. In addition to thenormal input manipulation, the movement speed of the finger can beacquired, whereby the display expression of the GUI can be changed inaccordance with the movement speed of the finger. As a result, the usercan be made to recognize the input manipulation recognized by theinformation processor 100 in the easy-to-understand manner. As a result,the feedback of the manipulation inputting operation made by the userhimself/herself enhances the operability. In addition, the movementspeed of the finger is changed so as to execute the processingcorresponding to the input manipulation, which results in that itbecomes possible to select the processing to be executed.

Although the preferred embodiments of the present disclosure have beendescribed in detail so far with reference to the accompanying drawings,the present disclosure is by no means limited thereto. It is obviousthat a person who has the normal knowledge in the field of the techniqueto which the present disclosure belongs can think various changes andmodifications within the category of the technical idea described in theappended claims, and it is understood that the various changes andmodifications naturally belong to the technical scope of the presentdisclosure.

For example, although in the embodiments described above, it isdetermined whether or not the movement speed of the finger is higherthan one threshold value (predetermined speed) about the speed, and theprocessing to be executed is determined in accordance with thedetermination result, the present disclosure is by no means limitedthereto. For example, plural threshold values may be provided, and theprocessing to be executed may be determined in accordance with themagnitude of the movement speed of the finger with respect to each ofthe threshold values.

What is claimed is:
 1. An information processing apparatus comprising:circuitry configured to identify a position of a manipulation body inrelation to a detector and a distance between the detector and themanipulation body based on an output of the detector; identify a firstobject of a plurality of objects to be selected by the user anddisplayed on a display; determine a change in distance between themanipulation body and the detector over a predetermined period of timebased on the output of the detector after the first object has beenidentified on the display; and cause the display to indicate that thefirst object is placed in a selected state by modifying a visualappearance of the first object by causing the display to change thevisual depth of the first object based on the determined change indistance between the manipulation body and the detector over thepredetermined period of time, wherein modifying the visual appearance ofthe first object includes modifying the visual appearance of the firstobject so that a visual depth of the first object appears to sink intothe display, while a visual depth of the other of the plurality ofobjects is unchanged.
 2. The information processing apparatus of claim1, wherein the plurality of objects are initially displayed on thedisplay to visually appear on a same parallel surface.
 3. Theinformation processing apparatus of claim 1, wherein the circuitry isconfigured to control the display to change a form or shape of the firstobject when the change in distance between the manipulation body and thedetector over the predetermined period of time is greater than athreshold value.
 4. The information processing apparatus of claim 1,wherein the circuitry is configured to: cause the display to change thevisual depth of the first object when the change in distance between themanipulation body and the detector over the predetermined period of timeis greater than a threshold value; and cause the display to not changethe visual depth of the first object when the change in distance betweenthe manipulation body and the detector over the predetermined period oftime is less than the threshold value.
 5. The information processingapparatus of claim 4, wherein the circuitry is configured to compare thedetermined change in distance between the manipulation body and thedetector over the predetermined period of time to the threshold value.6. The information processing apparatus of claim 1, wherein thecircuitry is configured to execute a process corresponding to the firstobject when the change in distance between the manipulation body and thedetector over the predetermined period of time is greater than athreshold value.
 7. The information processing apparatus of claim 1,wherein the circuitry is configured to control the display to displayinformation related to the first object when the change in distancebetween the manipulation body and the detector over the predeterminedperiod of time is greater than a threshold value.
 8. The informationprocessing apparatus of claim 1, wherein the circuitry is configured toidentify the first object of the plurality of objects displayed on thedisplay to be in the selected state based on the determined change indistance between the manipulation body and the detector over thepredetermined period of time.
 9. The information processing apparatus ofclaim 8, wherein the circuitry is configured to control the display toindicate that the first object is placed in the selected state when thechange in distance between the manipulation body and the detector overthe predetermined period of time is greater than a threshold value. 10.The information processing apparatus of claim 9, wherein the circuitryis configured to cause the first object to not be placed in the selectedstate when the change in distance between the manipulation body and thedetector over the predetermined period of time is less than thethreshold value.
 11. The information processing apparatus of claim 1,wherein the detector is configured to detect movement of a manipulationbody in an oblique direction in relation to the detector, and thecircuitry is configured to determine a process to be executed based onwhether the detected movement of the manipulation body is in a verticalor oblique direction in relation to the detector.
 12. The informationprocessing apparatus of claim 1, wherein the circuitry is configured to:cause the display to change the information displayed by the displayfrom displaying the plurality of objects to displaying a new object thatis different from the plurality of objects after the visual appearanceof the first object has been modified.
 13. An information processingmethod performed by an information processing apparatus, the methodcomprising: identifying a position of a manipulation body in relation toa detector and a distance between the detector and the manipulation bodybased on an output of the detector; identifying a first object of aplurality of objects to be selected by the user and displayed on adisplay; determining a change in distance between the manipulation bodyand the detector over a predetermined period of time based on the outputof the detector after the first object has been identified on thedisplay; and causing the display to indicate that the first object isplaced in the selected state by modifying a visual appearance of thefirst object by causing the display to change the visual depth of thefirst object based on the determined change in distance between themanipulation body and the detector over the predetermined period oftime, wherein modifying the visual appearance of the first objectincludes modifying the visual appearance of the first object so that avisual depth of the first object appears to sink into the display, whilea visual depth of the other of the plurality of objects is unchanged.14. The information processing method of claim 13, wherein the causingincludes: causing the display to change the visual depth of the firstobject when the change in distance between the manipulation body and thedetector over the predetermined period of time is greater than athreshold value; and causing the display to not change the visual depthof the first object when the change in distance between the manipulationbody and the detector over the predetermined period of time is less thanthe threshold value.
 15. A non-transitory computer-readable mediumincluding computer program instructions, which when executed by aninformation processing apparatus, cause the information processingapparatus to: identify a position of a manipulation body in relation toa detector and a distance between the detector and the manipulation bodybased on an output of the detector; identify a first object of aplurality of objects to be selected by the user and displayed on adisplay; determine a change in distance between the manipulation bodyand the detector over a predetermined period of time based on the outputof the detector after the first object has been identified on thedisplay; and cause the display to indicate that the first object isplaced in the selected state by modifying a visual appearance of thefirst object by causing the display to change the visual depth of thefirst object based on the determined change in distance between themanipulation body and the detector over the predetermined period oftime, wherein modifying the visual appearance of the first objectincludes modifying the visual appearance of the first object so that avisual depth of the first object appears to sink into the display, whilea visual depth of the other of the plurality of objects is unchanged.16. The non-transitory computer-readable medium of claim 15, wherein thecausing includes: causing the display to change the visual depth of thefirst object when the change in distance between the manipulation bodyand the detector over the predetermined period of time is greater than athreshold value; and causing the display to not change the visual depthof the first object when the change in distance between the manipulationbody and the detector over the predetermined period of time is less thanthe threshold value.